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ABSTRACT 
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Hamming.  Golay,  Bose-Chaudhuri-Hocquenghem  (BCH),  Reed-Solomon  (R-S)  block 
codes  as  well  as  convolutional  codes  are  presented  and  analyzed  in  the  context  of  specific 
MFQPSK  system  parameters.  A  computer  program  was  developed  in  order  to  compute 
bit  error  probabilities  as  a  function  of  signal-to-noise  ratio.  Results  demonstrate  that 
various  EDC  schemes  are  suitable  for  the  MFQPSK  signal  structure,  and  that  significant 
performance  improvements  are  possible  with  the  use  of  certain  error  correction  codes. 
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I.     INTRODUCTION 

A.  CONCEPT  OF  OPERATIONS 

Modulation  is  the  process  by  which  signals  are  transformed  into  waveforms  tailored 
to  the  characteristics  of  the  transmission  channel.  The  medium  for  the  data  transmission 
may  be  free  space,  a  wire,  an  optical  fiber  or  underwater  acoustics,  each  possibly  re- 
quiring a  different  modulation  technique.  It  is  not  desireable  to  have  to  design  com- 
munications links  around  the  type  of  modulation  dictated  by  the  propogation  medium. 
A  single  modulation  technique  that  is  flexible,  can  be  used  for  analog  and  digital  signals, 
is  not  channel  restrictive,  and  can  emulate  existing  modulation  techniques  would  be 
ideal. 

Multi-Frequency  Modulation  (MFM)  [Ref.  1]  is  a  technique  that  embodies  some 
of  the  above  characteristics.  Developed  at  the  Naval  Postgraduate  School,  MFM  was 
designed  for  computer-to-computer  communication  links  and  information  exchange 
networks.  Applications  of  MFM  to  Navy  satellite  communication,  ship-to-ship  shore 
communication  and  acoustic  communication  are  being  considered.  MFM  systems  op- 
erating at  audio  frequencies  are  particularly  suited  to  acoustic  communications.  Con- 
current research  with  Naval  Ocean  Systems  Center  (NOSC),  San  Diego  is  ongoing  in 
this  area.  More  specifically,  a  Multi-Frequency  Quaternary  Phased  Shift  Keyed 
(MFQPSK)  signaling  system  is  being  built  and  tested  by  NOSC  with  Naval  Postgraduate 
School  assistance. 

B.  PREVIOUS  RESEARCH 

The  MFQPSK  signaling  system  is  well  suited  for  high  data  rate  acoustic  communi- 
cations [Ref.  2].  Research  in  MFQPSK  signaling  systems  at  the  Naval  Postgraduate 
School  is  currently  in  progress.  However,  past  efforts  in  this  area  of  research  have  pri- 
marily focused  on  the  generation  of  the  signal  itself  through  Fast  Fourier  Transform 
techniques.  Limited  attention  has  been  given  to  the  quality  of  the  received  signal.  That 
is,  error  detection  correction  (EDC)  has  played  a  minor  role  in  signal  development  to 
date.  During  an  initial  feasibility  study,  a  single  error  correction/double  error  detection 
radix-5  Hamming  code  was  proposed  [Ref.  3].  However,  since  this  initial  proposal,  EDC 
coding  has  been  generally  neglected,  although  it  is  seen  as  a  necessary  tool  for  the  suc- 
cessful use  of  MFQPSK. 


C.     OVERVIEW 

The  purpose  of  this  study  is  to  explore  various  coding  schemes  and  evaluate  their 
effectiveness  when  used  in  conjunction  with  MFQPSK  signaling.  Three  coding  schemes 
in  particular  (BCH,  Reed-Solomon  and  convolutional)  are  singled  out  and  explored  in 
depth.  An  algorithm  was  developed  to  evaluate  the  performance  of  these  codes  and  their 
application  to  this  project.  Chapter  Two  describes  the  MFQPSK  signal,  so  as  to  provide 
a  brief  conceptual  understanding  of  the  signal  without  going  into  the  in-depth  explana- 
tion that  can  be  found  in  References  1  and  4.  In  Chapter  Three,  derivation  of  the  basic 
probability  equations  and  explanation  of  some  of  the  channel  variables  that  affect  signal 
transmission  are  presented.  Chapter  Four  presents  a  detailed  discussion  of  various 
coding  schemes  and  their  associated  bit  error  performance.  Some  schemes  (such  as 
Hamming  and  Golay  codes)  are  presented  for  completeness  in  describing  the  funda- 
mentals of  coding  theory  but  are  not  analyzed  in  depth  in  so  far  as  their  application  to 
MFQPSK  signaling.  Chapter  Five  is  devoted  to  the  application  of  error  performance 
characteristics  of  various  coding  schemes  to  the  MFQPSK  signaling  system.  Chapter  6 
concludes  this  study  by  singling  out  a  particular  coding  scheme  that  is  well-suited  for  the 
MFQPSK  signaling  and  suggesting  areas  of  further  research. 


II.     THE  MFQPSK  SIGNAL 

The  specific  design  parameters  of  the  MFQPSK  signal  used  in  this  research  project 
are  not  necessarily  design  constraints  on  the  EDC  coding  scheme.  However,  they  are 
included  here  in  order  to  provide  the  reader  with  a  better  understanding  of  the  MFQPSK 
signal  and  the  overall  MFQPSK  communication  system  operation.  By  modulating  fre- 
quencies with  phase  information  and  using  frequency  to  time  domain  transformations 
via  the  Fast  Fourier  Transform  (FFT),  the  MFQPSK  transmission  signal  can  be  gener- 
ated. 

Figure  1  shows  the  basic  structure  of  the  MFQPSK  signal. 
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Figure  I.      The  Structure  of  the  MFQPSK  Signal 


Frequency  is  plotted  on  the  vertical  axis  depicting  M  tones,  Af  Hz  apart.  Time  is  plot- 
ted on  the  horizontal  axis  showing  Ar  bauds  each  of  length  AT  seconds.    The  symbols, 


{4>tJ}  represent  the  phase  of  the  j'h  tone  in  the  /'*  baud.  In  quadrature  phase 
(2  bits  symbol),  {$,)  -  |  ±  -f  ,  ±  ^f-  j  . 

In  the  MFQPSK  signaling  system,  the  {$,,}  components  represent  unique 
time  frequency  phases.  These  components  and  their  complex  conjugate  at  the  image 
frequencies  are  loaded  into  a  two  dimensional  array  that  is  used  as  an  input  to  an  In- 
verse Fast  Fourier  Transform  (IFFT).  The  image  frequency  components  are  needed  to 
insure  that  the  corresponding  time  domain  signal  is  entirely  real.  Thus,  the  IFFT  gen- 
erates a  collection  of  real,  time  domain  signal  sequences  that  are  time  samples  of  the 
analog  transmit  signal.  Processing  these  through  a  D/A  converter  completes  the  gener- 
ation of  the  /**  baud.  The  total  signal  packet  is  completed  by  an  A7- fold  repetition  of  this 
frequency-to-time  domain  transformation. 

A  complete  data  packet,  P,  is  made  up  of  M  tones  in  N  bauds.  (It  is  not  necessary 
that  all  of  the  frequency  bins  contain  data  information.  The/*  tone  could  be  used  for 
synchronization  for  example.)  Since  one  of  four  phases  is  determined  by  a  di-bit  (a  se- 
quence of  two  binary  bits)  there  will  be  2NM  bits  in  each  packet.  The  tone  spacing  is 
the  inverse  of  the  baud  length.  By  increasing  baud  lengths,  more  tones  are  used  and 
vice-versa. 

Demodulation  of  the  MFQPSK  signal  is  accomplished  by  a  process  that  is  just  the 
opposite  of  the  method  of  generation.  The  time  domain  signal  is  filtered,  sampled  and 
converted  to  a  digital  format  through  an  A/D  converter.  This  sequence  is  partitioned 
into  Ar  sequences  corresponding  to  the  N  bauds  and  loaded  into  a  complex  valued  array 
with  imaginary  parts  set  to  zero.  This  array  becomes  the  input  to  an  FFT  which  gen- 
erates a  complex  valued  array  containing  the  phases  of  the  original  transmitted  baud. 
Computing  this  A*- fold  times,  will  generate  the  total  transmitted  data  packet. 

This  brief  explanation  is  pro\ided  for  conceptual  purposes  only  and  intentionally 
does  not  address  the  problems  of  synchronization,  channel  noise,  multipath  propagation 
and  non-linear  characteristics  of  the  supporting  equipment.  Individually,  these  are  sub- 
jects of  various  research  projects  currently  associated  with  the  MFQPSK  signaling  sys- 
tem. 


III.     CHANNEL/CODING  CONSIDERATIONS 

A.  CHANNEL  CONSIDERATIONS 

The  acoustic  properties  of  the  ocean  constrain  the  MFQPSK  signal  in  this  applica- 
tion in  various  ways.  For  instance,  since  short  signal  wavelengths  are  absorbed  more 
readily  than  longer  wavelengths,  the  signal  transmission  bandwidth  is  limited  by  the  de- 
sired maximum  range  of  communications.  This  will,  in  turn,  constrain  the  maximum 
rate  at  which  data  can  be  transmitted.  Another  channel  consideration  concerns  the 
multipath  characteristics  of  acoustic  propagation.  Surface  and  sea  bottom  reflections 
as  well  as  sound  channels  may  cause  the  signal  to  propagate  through  various  paths  with 
different  delays.  Doppler  shift  due  to  the  movement  of  the  source  and  the  random  dy- 
namics of  the  sound  velocity  pose  additional  problems. 

Acoustic  channel  modeling  for  the  MFQPSK  signaling  system  is  a  separate  project 
being  explored  at  the  Naval  Postgraduate  School.  Its  purpose  is  to  identify  and  model 
important  the  variables  of  acoustic  signal  transmission.  Also  included  in  the  model  are 
the  symbol  energy-to-noise  spectral  density  ratio  EJX0,  the  bandwidth  and  data  rate. 
(Since  EJX,,  is  actually  a  signal-to-noise  ratio  it  will  be  referred  to  simply  as  SNR 
throughout  this  work.)  Once  complete,  coding  gains  can  be  computed  based  on  this 
model  as  a  function  of  SNR,  baud  length,  doppler  mismatch,  etc. 

B.  CODING  CONSIDERATIONS 

In  this  signaling  system,  the  purpose  is  to  transmit  digital  information  at  the  maxi- 
mum possible  rate  with  a  fixed  signal  power  while  maintaining  adequate  error  perform- 
ance. Varying  definitions  of  adequate  error  performance  has  led  to  the  specification  of 
many  EDC  coding  schemes,  each  exploiting  some  feature  of  the  transmitter-channel- 
receiver  trilogy.  If  the  medium  introduces  high-level  constant  noise,  increasing  trans- 
mitted power  may  be  the  only  means  to  compensate  for  the  noise  and  ensure  adequate 
receiver  performance.  Perhaps  full  replication  of  the  transmitted  signal  is  not  needed 
on  the  receiving  end.  In  this  case,  a  lower  transmitter  power  may  be  used  and  the 
transmitted  signal  extrapolated  from  what  is  received.  Additional  signal  degradation 
from  such  variables  as  mulitpath  propagation,  fading,  and  doppler  shift  further  reduce 
the  received  SNR  and  or  create  decoding  errors  and  amplify  the  need  for  error  detection 
and  correction. 


The  MFQPSK  signal  is  to  be  encoded  from  a  binary  data  stream.  Figure  2  shows 
the  block  structure  of  a  binary  data  stream,  how  it  is  partitioned  into  information  and 
parity  bits  and  illustrates  the  meaning  of  a  di-bit. 
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Figure  2.      Block  Coding  of  a  Binary  Data  Stream 

Due  to  the  randomness  of  phase  assignments,  it  may  be  assumed  that  any  incorrect  de- 
cisions of  the  receiver  will  have  equal  probabilities. 

In  light  of  the  channel  considerations  previously  discussed,  a  coding  scheme  must 
be  identified  which  will  provide  adequate  error  performance.  However,  since  all  these 
studies  are  not  yet  complete,  all  performance  graphs  in  this  thesis  will  be  plotted  showing 
probability  of  error  as  a  function  of  SNR. 

1.     Probability  Development 

In  this  study,  two  error  probabilities  will  be  continually  compared.  The  first 
will  be  that  of  a  MFQPSK  signal  which  is  not  EDC  coded.  In  this  case,  bit  error 
probabilities  will  be  dependent  on  the  type  of  demodulation  used.  Secondly,  EDC  coded 
received  signal  error  performance  for  particular  coding  schemes  will  be  developed  and 
compared  to  each  other  in  order  to  evaluate  which  coding  schemes  may  be  most  suitable 
for  an  MFQPSK  signaling  system. 
a.     Uncoded  transmission 

In  determining  the  probability  of  error  for  an  uncoded  bit  stream,  the  pri- 
mary consideration  is  the  modulation  type.  Since  there  is  no  coding  involved,  this  will 
specify  the  performance  of  the  signaling  system.  Figure  3  illustrates  a  QPSK  signaling 
constellation  developed  from  Reference  5  . 


Figure  3.      QPSK  Signal  Constellation  Diagram 


Receiving  two  bits  of  information,  left  bit  and  right  bit  (Lb  and  Rb,  respec- 
tively), the  probability  that  the  left  bit  was  received  correctly  (LbQ  in  additive  white 
Gaussian  noise  given  that  signal  s0  was  transmitted  is: 


Z 


Pr{LbCjs0)  =  Pr{LbClsx)  =  1-fiU^ 


(3.1) 


=  Pr{LbC) 


(3.1a) 


The  function  Q(x)  is  the  complementary  error  function  or  co-error  function  and  is  de- 
fined as: 


J2n    Jx         \       z 


du 


(3.2) 


Equation  (3.1a)  now  represents  the  unconditional  probability  that  Lb  is  correct.  This  is 
irrespective  of  what  signal  was  transmitted.  Similarly,  the  unconditional  probability  that 
Rb  is  correct  is  identical.   Thus, 


Pi -{bit  correct)  =  1  -  {?(    /-rp 


A<' 


(3-3) 


Therefore,  the  bit  error  probability  is 


Es 


p  =  Pr{bit  incorrect)  =  1  —  Pr{bit  correct)  —  Q[     /"T7~ 


(3.4) 


A  graph  of/?  as  a  function  of  EJN0,  denoted  SNR,  is  shown  in  Figure  4. 
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Figure  4.      Bit  Error  Probability  for  Uncoded  QPSK  Signals 


b.     Received  EDC  coded  transmission 

When  a  bit  stream  is  transmitted  over  a  noisy  channel,  errors  will  occur 
causing  the  transmitted  and  received  bit  streams  to  differ.  Given  that  a  specific  bit  was 
transmitted,  the  probability  that  it  is  received  in  error  is  p,  and  the  probability  that  it  is 
correctly  received  is  (1  -  p).  Given  a  message  consisting  of  a  string  of/?  bits,  the  proba- 
bility of  no  error  in  all  n  bits  is  the  individual  correct  probabilities  raised  to  the  number 
of  n  bits,  namely, 

(1-P)n  (3.5) 

and  the  probability  of  a  single  error  in  the  n  bits  is: 

nP(\-p)n-]  (3.6) 

Similarly,  the  probability  of  exactly  two  errors  in  the  n  bits  is: 

n{n  —  1)     -,  „_9 

„        p\\-pf  (3-7) 


Equations  (3.6)  and  (3.7)  represent  exact  values  for  probability  of  error.  This  is  for  the 
case  that  exactly  n  or  fewer  errors  are  detected  and  corrected.  Codes  that  do  this  are 
called  perfect  codes.  As  will  be  explained  in  Chapter  4,  there  are  very  few  perfect  codes: 
the  Hamming  {t  —  1),  the  Golay  (i  =  3)  and  a  ternary  Golay  code  are  examples.  Other 
/-error  correcting  codes  can  correct  all  occurrences  of  /  errors  and  varying  percentages 
of  more  than  /  errors.  When  computing  PB  for  non-perfect  codes,  it  is  understood  that 
the  code  is  capable  of  correcting  all  occurrances  of7<  /  errors.  However,  more  that  / 
errors  can  occur,  that  is j=t  +  1.  resulting  in  decoded  errors.  Therefore,  by  summing 
the  total  probability  of/  errors  in  the  n  positions  and  dividing  by  the  number  of  bits  leads 
an  upper  bound  on  PB%  the  probability  of  bit  error  of /-error  correcting  codes: 

pB^irlJj(j)p'^-p)n~J  (3-8) 


where  p  =  Q(%'SXR  ).  A  plot  of  equation  (3.9)  appears  as  Figure  5. 


6.0  7.5  0.0 

SNR  (DECIBELS) 


12.0 


Figure  5.      General  Bit  Error  Probability  for  Coded  Signals 
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IV.     ERROR  DETECTION/CORRECTION  CODES 

A.     FUNDAMENTAL  CONCEPTS 

Error  detection  correction  (EDC)  coding  provides  error  control  in  digital  informa- 
tion transmission.  An  encoder  adds  redundancy  to  a  transmitted  message  in  such  a 
manner  that,  upon  decoding,  the  correct  digital  information,  even  in  the  presence  of 
channel-induced  errors,  can  be  determined.  Redundancy  is  added  in  such  a  way  that  the 
decoder  decisions  can  be  based  on  several  received  bits  rather  than  on  one,  as  in  uncoded 
systems. 

Error  control  can  be  accomplished  using  forward  error  correction  (FEC),  automatic 
repeat  request  (ARQ),  or  a  variety  of  hybrid  FEC-ARQ  approaches.  Using  FEC,  the 
decoder  corrects  as  many  channel  errors  as  possible.  This  is  done  by  generating  an  es- 
timate of  the  transmitted  sequence  within  the  limitations  of  the  code.  Using  ARQ,  the 
decoder  detects  errors  and  prompts  the  transmitter  to  retransmit  as  required.  Because 
of  the  duplex  nature  of  the  ARQ  procedure,  it  was  not  considered  viable  for  this  project. 
Therfore  FEC  coding  only  is  being  considered  here. 

FEC  codes  can  be  classified  in  two  general  categories,  block  and  convolutional. 

1.  Block  Codes 

Block  codes  process  data  in  blocks  that  are  independent  from  each  other.  The 
encoder  transforms  a  block  of  k  message  bits  into  a  block  of  n  binary  coded  bits,  where 
n>  k.  The  ratio  of  kjn  is  called  the  code  rate  R,  where  0  <  R  <  1.  Block  codes  are 
expressed  in  terms  of  n  and  k  such  as  a  (n,  k)  code.  A  block  code  represents  a  one-to-one 
transformation  where  2*  information  /(-tuples  are  uniquely  mapped  into  a  set  of  2k 
codeword  //-tuples. 

A  wide  variety  of  linear  block  codes  exist.  The  ones  that  will  be  considered  here 
as  they  may  apply  to  this  project  include:  the  Hamming,  Golay,  Bose-Chaudhuri- 
Hocquenghem  (BCH),  and  Reed-Solomon  (R-S)  codes. 

2.  Convolutional  Codes. 

Convolutional  codes  provide  n  output  coded  bits  for  each  group  of  A:  input  bits. 
However  any  w-coded  bit  convolutional  encoder  output  depends  not  only  on  the  last  set 
of  A:  input  bits  but  also  on  several  preceeding  sets  of  input  bits.  Convolutional  encoders 
are  described  by  n,  k  and  K.  The  code  rate,  R,  is  defined  by  kjn  ,  and  K,  known  as  the 
constraint  length,  is  the  number  of  stages  in  the  shift  register  used.    Shift  registers  are 
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used  to  process  the  bit  stream.  As  a  bit  is  fed  into  the  shift  register,  that  particular  block 
of  bits  in  the  shift  register  are  modulo-2  added  in  a  predetermined  manner,  described  by 
so-called  generating  polynomials,  and  the  encoded  bit  stream  output  is  taken  from  the 
modulo-2  adders.  The  next  bit  is  then  fed  into  the  shift  register  causing  all  previous  bits 
to  shift  one  stage  and  the  output  is  again  taken  from  the  modulo-2  adders.  This  process 
is  repeated  until  all  the  information  bits  are  processed  through  the  shift  register. 
Convolutional  codes  are  expressed  either  as  («,  A,  K)  or  (R,  K).  As  an  example,  a 
(1/2,  3)  convolutional  encoder  is  shown  in  Figure  6. 


Input  bit 
m 


First 
code  symbol 


Output 
branch  word 


Second 
code  symbol 


Figure  6.      Convolutional  Encoder:     (Rate  =    1/2,  AT  =  3,  reproduced  from  page 
319  of  Reference  [6]) 

B.     HAMMING  CODES 

Hamming  codes  are  a  class  of  block  codes  used  for  error  detection  and/or  correction 
applications.  They  are  also  members  of  a  group  of  codes  called  perfect  codes.  A  perfect 
code  is  one  in  which  all  the  vectors  described  by  the  code  are  contained  within  a  sphere 
of  radius  f=  [(Jmin  — 1)/2]  about  the  codewords.  Here  /  represents  the  number  of  errors 
the  code  can  correct  and  dmM  is  the  minimum  distance  between  codewords  of  the  code. 
Minimum  distance  is  an  integral  part  of  determining  the  error  correcting  capability  of 
block  codes.   To  define  dmm,  consider  the  following:   if  u  and  v  are  two  vectors  of  a  code 
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then,  by  definition,  u  ©  v  must  also  be  a  code  vector  where  code  vectors  represent  a  bit 
sequence  of  length  n  and  ©  indicates  modulo-2  addition.  The  Hamming  distance  be- 
tween any  two  code  vectors  is  equal  to  the  number  of  places  where  the  two  code  vectors 
disagree.  This  corresponds  to  the  weight  (i.e.,  number  of  l's)  of  u  ©  v.  Thuis  dmin  is  the 
minimum  weight  of  all  non-zero  code  vectors.  A  Hamming  code  has  (n  =  2m-l,  k  = 
2m  -1-ra,  dmm  =  3).  Therefore,  one  can  see  the  (7,  4)  Hamming  code  has  a  minimum 
weight  of  dmin  =  3  and  therefore,  has  a  single  error  correcting  capability.  The  binary 
Hamming  (7,  4)  code  is  also  perfect  since  23  (the  number  of  vectors  in  a  sphere  of  radius 
1  about  a  codeword)  times  24  (number  of  codewords)  equals  T,  the  total  number  of 
vectors  [Ref  7). 

Hamming  codes  are  developed  around  some  basic  principles: 

•  All  noise  is  modeled  as  channel  noise. 

•  The  channel  is  a  binary  symmetric  channel. 

•  In  all  computations,  modulo  base  must  equal  radix  base  (in  most  cases  this  will  be 
modulo  2). 

•  Hard  decision  decoding  is  used.l 

Parity  check  matrix  and  syndrome  development  are  necessary  when  evaluating  block 
codes.  The  parity  check  matrix  H  consists  of  all  nonzero  m-tuples  as  its  columns,  ar- 
ranged in  the  following  form: 

H  =  [I  Q]  (4.1) 

where  I  is  an  m  x  m  identity  matrix  and  the  submatrix  Q  consists  of  2m-m-\  columns 
which  are  m-tuples  of  weight  2  or  more.   As  an  example,  with  m  =  3, 


H  = 


10  0  0  111 
0  10  10  11 
0  0  1110  1 


(4.2) 


The  coded  vector  c  of  a  Hamming  code  is  constructed  from  binary  representations 
of  position  locations.  All  odd  numbered  positions  end  with  a  1  when  represented  in  bi- 
nary form.  Therefore,  a  parity  check  is  used  to  cover  the  odd  positions  1,  3,  5,  7,  .... 
Similarly,  the  second  parity  check  covers  positions  2,  3,  6,  7,  10,  11  all  these  positions 


1    Hard  decisions  refer  to  the  cases  in  which  no  confidence  associated  with  the  bit  decision  is 
known. 
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have  a  1  in  the  second-lowest  position  in  its  binary  form.  The  third  parity  check  will 
cover  positions  4,  5,  6,  7,  12,  13,  14,  15,  .... 

If  the  information  to  be  transmitted  contains  four  bits,  say  [1  0  1  0],  the  coded  vector 
will  be  constructed  as  [-  -  1  -  0  1  0]  where  the  (-)  are  used  as  parity  checks.  The  total 
number  of  odd  positions  l's  are  modulo-2  added  and  the  result  entered  in  the  first  posi- 
tion. Now  c  =  [1-1-010].  Next,  the  second  parity  check  is  entered  in  position  two 
as  the  modulo-2  sum  of  the  digits  in  positions  2,  3,  6,  and  7.  The  coded  vector  is  now 
[10  1-010].  Finally,  by  modulo-2  adding  the  l's  in  positions  4,  5,  6,  and  7  the  third 
parity  check  is  accomplished  and  c  is  completed  as  [1  0  1  10  10]. 

Given  a  coded  transmitted  vector  c,  where  c  is  the  coded  bit  stream  of  information 
bits  and  error  correction  coding,  and  a  received  vector  r,  Reference  [8]  defines  the  syn- 
drome as  S  =  rH  .  The  syndrome  will  be  used  to  locate  error  positions.  If  no  trans- 
mission errors  occur  then,  since  He7"  =  0,  Hrr  =  0  because  r  =  c  . 

To  continue  the  above  example,  let  c  =  r  =  [10  110  10].  This  is  the  desired 
coded  transmission  and  contains  no  errors.   Therefore,  the  syndrome 

S  =  Hrr=0 


10  0  0  111 
0  10  10  11 
0  0  1110  1 


=  0 


(4.3) 


If  a  single  error  were  introduced,  the  received  vector  would  be:  r  =  (c  +  e)  where  c  re- 
presents the  transmitted  vector  and  e  represents  an  introduced  error.  Computing  the  S 
vector,  S  =  Hcr+  He7"  and  knowing  that  Hcr=  0  ,  S  =  He7".  The  syndrome  depends  on 
the  error  vector  and  not  on  the  codeword  sent.  The  syndrome  is  a  vector  which  repres- 
ents the  column  where  the  errors  occur. 

Now  using  the  previous  example,  let  the  transmitted  vector  be 


c  =  [1011010] 


(4.4) 


and  let  e  =  [  0  0  0  1  0  0  0  ],  so  that  r  =  [10  10  0  10]. 
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Since 


and 


H  cT  +  H  eT  =  S 


Hcr=0, 


then, 


S  = 


10  0  0  111 
0  10  10  11 
0  0  1110  1 


1 

0 

1 

"o" 

0 

= 

1 

0 

1 

1 

0 

(4.5) 


Comparing  the  syndrome  to  the  H  matrix  shows  that  entries  in  the  fourth  column 
of  H  are  identical  to  the  syndrome  thus  indicating  an  error  in  the  fourth  position  of  the 
received  vector.  By  inverting  the  digit  in  this  position,  a  correction  to  the  received  vector 
is  accomplished. 

Hamming  codes  can  easily  be  extended  to  double  error  detection  single  error  cor- 
rection codes  by  adding  a  parity  check  as  the  top  row  of  the  matrix.  For  example,  the 
H  matrix  of  Equation  (4.2)  results  in 


H  = 


11111111 
10  0  0  1  1  10 
0  10  10  110 
0  0  1110  10 


(4.6) 


The  usefulness  of  this  extension  is  limited  as  the  extended  Hamming  code  can  only  detect 
the  existence  of  a  double  error,  and  still  only  correct  single  errors. 

Hamming  codes  were  developed  for  self-checking  of  the  Model  5  Relay  Computers 
built  by  Bell  Telephone  Laboratories  in  the  late  1940's  [Ref.  8].  Because  of  computer 
infancy  at  the  time  of  the  code's  creation,  Hamming  codes  are  relatively  simple  and  of 
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limited  capabilities  by  today's  standards.    However,  they  serve  as  the  cornerstone  of 
EDC  coding  and  are  described  in  this  report  for  completeness. 

The  initial  feasibility  study  of  the  MFQPSK  signal  included  a  radix-5  Hamming  code 
for  each  of  the  frequency  bins  [Ref.  3].  Using  modulo-5  algebra  and  a  two-dimensional 
matrix,  the  radix-5  code  proved  useful.  However,  as  with  all  Hamming  codes,  it  was 
only  capable  of  single  error  correction. 

C.  GOLAY  CODES 

The  next  extension  of  the  Hamming  code  is  the  Golay  code.  Like  the  Hamming 
code,  the  (23,  12)  Golay  code  is  also  a  perfect  code.  In  fact,  the  Hamming  and  Golay 
codes  are  the  only  known  binary  perfect  codes. 2  Because  the  code  rate  (kjn  =  12/23),  is 
awkard  to  work  with,  a  parity  bit  is  added  creating  an  extended  (24,  12)  Golay  code. 
This  added  parity  bit  increases  dmm  from  7  to  8.  Both  Golay  codes  possess  triple  error 
correcting  capabilities.  The  extended  Golay  code  is  more  powerful  than  the  Hamming 
codes  but  also  carries  drawbacks:  a  more  complicated  decoder,  a  lower  code  rate  and, 
with  it,  greater  bandwidth  expansion. 

Although  Golay  codes'  error  performances  are  superior  to  Hamming  codes,  from  a 
practical  point  of  view,  Golay  codes  are  limited  by  their  short  block  lengths  and  have 
limited  practical  application  when  considering  the  availability  of  other  more  powerful 
codes.  The  Golay  code's  uniqueness  as  a  perfect  code  (or  quasi-perfect  for  the  extended 
Golay  code)  carries  with  it  many  mathematical  properties  which  are  used  in  coding  the- 
ory to  group  theory  and  other,  more  esoteric,  mathematical  topics. 

D.  BCH  CODES 

Of  the  many  classes  and  subclasses  of  random  error-correcting  codes  proposed  to 
date,  the  class  discovered  by  Hocquenghem  in  1959  and  independently  by  Bose  and 
Chaudhuri  in  1960  is  the  most  extensive  and  powerful  one.  The  Bose-Chaudhuri- 
Hocquenghem  (BCH)  codes  are  a  generalization  of  the  Hamming  codes  but  allow 
multiple-error  correction,  while  providing  a  large  selection  of  block  lengths,  code  rates, 
and  error  correcting  capability.  Because  of  this  flexibility,  there  are  many  BCH  code 
implementation  algorithms.  At  block  lengths  of  a  few  hundred,  the  BCH  codes  outper- 
form many  other  block  codes  with  similar  block  length  and  code  rate  [Ref.  6]. 

For  any  positive  integer  m  and  t  (/  <  2m-1),  there  exists  a  BCH  code  with  the  fol- 
lowing parameters: 


2  There  is  a  perfect  ternary  (11,  6)  Golay  code  but  it  will  not  be  discussed  in  this  research. 
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Block  length:  n  —  2m  -1 

Number  of  parity-check  digits:  n  -  k  <  ml 

Minimum  distance:  dmiD  >  2t  +  1 

This  code  is  capable  of  correcting  any  combination  of  t  or  fewer  errors  in  a  block 
of  n  =  2m  -1  digits. 

The  alphabet  of  a  BCH  code  for  n  =  (2m  —  1)  may  be  represented  by  the  elements 
of  the  appropriate  Galois  Field,  GF(2m),  whose  primitive  element  is  a.  The  generator 
polynomial,  g(  • )  of  the  /-correcting  BCH  code  is  given  by  the  least  common  multiple 
(LCM)  of  M^X),  M2(X) M2l(X).   That  is, 

g(A-)  =  LCMIM^X),  M2(X), ...,  M2l{X)-]  (4.7) 

where  M,{X)  is  the  minimum  polynomial  of  of  a',  i  =  1,  2,  ...,  It,  each  unique  to 
GF(2m)  .3  Since  the  minimum  polynomials  for  a2,  ad, ...,  a2'  (all  even  powers  of  a  )  are  the 
same  as  those  of  a.  a2,  a3,  .  .  .  ,  the  generator  polynomial  is  reduced  to: 

g(X)  =  LCMIMX{X),  M3(X), U2,_,(A-)]  (4.8) 

Values  for  M,{X)  are  tabulated  in  texts  and  technical  reports  based  on  values  of  m  for 
specific  GF(2m). 

Consider  a  (15,  7)  double-error  correcting  BCH  binary  code  for  which  m  =  4.  The 
generating  polynomial  is: 

g(A1  =  LCV/[A/1(A0,A/3(ATJ  (4.9) 

=  M](\r\li(X) 
=  (1  +  X  +  XA){\  +  X  +  X2  +  A'3  +  X4) 

=  l+A/4  +  Ar6  +  A/7  +  Ar8  (4.9a) 

Similarly,  for  a  (15,  5)  triple-error  correcting  BCH  binary  code  over  GF(24),  the  gener- 
ating polynomial  is: 

g{X)  =  LCMIM^X),  M3{X),  A/5(AT]  (4.10) 


3  The  minimum  polynomial  over  GF(2m)  of  ft  is  the  lowest  degree  monk  polynomial  A/(/S) 
with  coefficients  from  Gf(2m)  such  that  M((i)  =  0. 
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=  MX{X)M2{X)M5{X) 
=  (1  +  X+X*)(\  +  X+  X2  +  X3  +  ^(l  +  Z+  X2) 

=  1  +X+X2  +  Z4  +  ^4  +  Z5  +  Z8  +  X10  (4.10a) 

1.  Use  of  Generator  Polynomials 

Generator  polynomials  are  used  in  the  formulation  of  a  generator  matrix,  G, 
where  G  =  [I*  P]  and  a  parity  check  matrix  H,  where  H  =  [I„_*  P7].  A  code  vector 
c,  is  obtained  by  multiplying  the  message  vector  m  and  the  generator  matrix  G,  namely 

c  =  mG  (4.11) 

The  received  vector  r  will  consist  of: 

r  =  c  +  e  (4.12) 

(If  there  are  no  errors,  e  =  0.)   Obtain  the  syndrome  S, 

S  =  rHr=eHr  (4.13) 

Then  by  inverting  the  digits  at  the  locations  specified  by  the  syndrome,  the  decoded 
vector  d  is  obtained,  where  d  corresponds  to  c  so  long  as  there  are  t  or  fewer  errors. 

2.  Decoding  BCH  Codes 

Chapter  6  of  Reference  [9]  presents  a  detailed  discussion  of  decoding  BCH 
codes.  The  highlights  of  that  discussion  are  presented  here.  Consider  a  received  vector 
r  =  c(X)  +  e  (X)  as  before.  Since  g(X)  is  a  factor  in  c(X)  and  a,  a2, ...,  a.2'  are  the  roots 
of  g(X)  then, 

r(oc')  =  c(a')  +  e(cc')  (4.14) 

=  e(a')     /=1,2,  ...It  (4.14a) 

since  c(a')  =  0.     Define  now  the  syndrome  vector 

S;-  =  r(</)  (4.15) 

=  r0  +  i-y  +  r2(a')2  +  ...  +  r^cc')"-1     /-  1,  2, ...,  It  (4.15a) 

where  r0,  /',,...,  r„_,  are  the  coefficients  of  r(X)  .   Thus, 
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S,  =  e(a)  (4.16) 

=  e0  +  eia2  +  e2(a')2  +  ...  +  e^V)""1  (4.16a) 

In  order  to  simplyfy  the  notation,  assume  p  errors  have  occurred  where  0  <  p  <  t  at  lo- 
cations given  by  Xlt  X2,  ...,XP  and  magnitudes  (binary  digits)  given  by  Yu  Y2, ...,  Yp.  Then 
the  syndrome  vectors  may  be  written: 

Sl^YlXl+Y2X2  +  ...+  YpXp 
S2  -  YXX\  +  Y2X\  +  ...  +  Y^] 


(4.17) 


S2[=Y^+Y2xl!+...+  YpX2p' 

The  difficulty  in  solving  this  set  of  equations  is  due  to  their  non-linearity  and  non-unique 
solution.    By  defining  intermediate  variables  and  an  error  locator  polynomial,  /(z)  given 

by 

/(;)  -  )./  +  ).p_x2P~X  +  ...  +  ).xi  +  1  (4.18) 

which  has  zeros  at  the  inverse  error  locations  Xj\  1=  1,  2,  ...,  p.   Then, 

Hz)  =  (1  -  zA',)(l  -  zA'2)...(l  -  zXp)  (4.19) 

The  zeros  of  this  equation  lead  to  the  error  locations  and  are  equal  to  the  coefficients, 
>■»,  A,-n  •••,  K  of /(z).   The  coefficients  and  syndromes  are  related  by  the  matrix  equation: 
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(4.20) 


Provided  that  this  matrix  is  nonsingular,  and  therefore  invertible,  the  above  equation  can 
be  solved.   Proof  of  nonsingularity  is  found  on  page  169  in  Reference  10. 

Consider  for  example  a  (15,  7)  double  error  correcting  BCH  code  in  GF(2")  and 
modulo  polynomial  given  by  A'4  +  X  +  1,  so  that 


%{X)  =  X8  +  X1  +  X6  +  X4  +  1 


(4.21) 


If  the  message,  m(X)  =  (1  +  X),  then  the  transmitted  vector  is 

c{X)  =  X9  +  X6  +  X5  +  X4  +  1. 


(4.22) 


The  received  vector  is  now  assumed  to  be 


r(A0  =  X9  +  Xs  +  X6  +  X5  +  X4  +  X3  +  1 


(4.23) 


so  that 


e(X)  =  Xs  +  X3 


(4.24) 


Computing  the  syndromes  according  to  Equation  (4.17), 


c  8.3  13 

S,  =  a    +  a   =  a 


c  16    ,      6  11 

S-,  =  a     4-  a   =  a 


e  24    .       9        A 

S?  =  a     +  a   =  0 


c  32    .       12  7 

Si  =  a     +  a     =  a 


(4.25a) 
(4.25ft) 
(4.25c) 
(A.25d) 


The  determinant,  det  M 


Sx    S2 

s2  s, 


t*  0.  Therefore, 
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therefore, 


and, 


M  = 


13         11 

a       a 
a         0 


M_1  = 


41 


0    a 

4        6 

a     a 


=  [M"'] 


L^4j 


(4.26) 


(4.27) 


(4.28) 


0    a 

4         t 

a     a 


r   i 
a 


13 


(4.28a) 


Thus, 


\(   \  11    2    .       13       ,     , 

/\z)  =  a    z    +  a    z  +  \ 


=  (a  z+l)(a  2+  1) 


(4.29) 
(4.29a) 


The  error  locations  occur  in  the  3rd  and  8th  positions  giving  e{X)  =  ,Y*  +  A"3  .  By  in- 
verting the  digits  in  these  positions  of  the  received  vector,  error  correction  is  accom- 
plished. 

Various  numerical  methods,  e.g.,  Chien  search,  Berlekamp's  iterative  scheme, 
and  the  Peterson-Gorenstein-Zierler  algorithm,  have  been  developed  to  assist  in  solving 
the  error  locator  polynomial  of  the  BCH  codes.    Their  development  and  descriptive  use 
may  be  found  in  References  9,  10  ,  and  1 1. 
3.     Performance  Evaluation 

Error  performance  of  BCH  codes  are  based  on  maximum  likelihood  decoding 
principles.  Since  the  weight  structure  is  known  only  for  a  small  fraction  of  the  family 
of  BCH  codes,  most  decoding  algorithms  are  based  on  having  no  knowledge  of  the  code 
weight  structure.   This  leads  to  the  probability  relationship  expressed  in  Equation  (3.9). 
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An  upper  bound  to  the  decoded  bit  error  probability  can  be  found  from 
Equation  (3.8)  as  modified  for  BCH  coding: 


•  p^2(^L)Gy{i-prJ  (4-3o) 

Since  the  values  for  r,  n  and  k  are  known  for  all  values  up  to  n  =  1023,  Equation 
(4.30)  can  be  evaluated  as  a  function  of/?.  For  the  case  of  BCH  codes,  the  co-error 
function  is  modified  to  account  for  code  rate,  R: 


P  =  q(J™4-)  (4-31) 


A 


o 


Figure  7  illustrates  the  upper  bound  of  various  BCH  codes  as  derived  from 
Equations  (4.30)  and  (4.31). 
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Figure  7.      Performance  of  Various  BCH  Codes 

It  has  been  shown  in  Reference  12  that  between  code  rates  of  1/3  <  R  <  3/4,  a  broad 
maximum  of  coding  gain  versus  code  rate  for  fixed  values  of  n  occur.  Performance  de- 
grades significantly  for  particularly  high  or  low  code  rates.  Figure  7  illustrates  per- 
formance of  the  BCH  codes  with  R^\j2. 

E.     REED-SOLOMON  CODES 

A  very  important  subclass  of  nonbinary  BCH  codes  are  the  Reed-Solomon  (R-S) 
codes  which  achieve  the  largest  possible  minimum  distance  (</min)  for  any  linear  block 
code  with  specified  block  lengths.  For  nonbinary  codes,  the  distance  between  code 
words  is  defined  as  the  number  of  nonbinary  symbols  by  which  the  two  code  words  dif- 
fer.  The  minimum  distance  for  these  codes  are  given  by: 


4™  =  n-k+\ 


(4.32) 
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but  since  n  -  k  =  It, 

*Ln  =  2,+  l  (4.33) 

R-S  codes  use  a  non-binary  alphabet  of  2m  symbols  represented  by  GF(2m).  How- 
ever, for  R-S  coding  with  m  —  1,  q  =  2m,  the  symbol  field  GF(q)  and  the  error  locator 
field  G¥(qm)  are  the  same  (as  such,  R-S  codes  are  examples  of  a  ^-ary  BCH  codes).  For 
m  —  1,  the  q-ary  BCH  code  becomes  a  r-error  correcting  R-S  code  with  the  following 
parameters: 

Block  length:  n  =  q  -  1 

Number  of  parity  digits:  n  -  k  =  It 

Minimum  distance:  d  =  It  +  1 

1.     Generator  Polynomial 

Using  a  R-S  code  with  code  symbols  from  the  alphabet  established  by  GF(g) 
where  q  =  2m,  the  generator  polynomial  of  a  r-error  correcting  code  of  length  2m  —  1  is: 

g(.Y)  =  {X+a)(X+  a2)...(X+«21)  (4.34) 

where  a  is  a  primitve  element  of  GF(q).    This  is  always  a  polynomial  of  degree  2/  and 
satisfies  the  n  -  k  =  2t  constraint. 

As  for  BCH  codes,  the  R-S  code  vector  is  obtained  by  multiplying  the  generator 
matrix  and  the  message  vector  to  produce: 

c  =  mG  (4.35) 

Let 

c(A-)  =  c0  +  c, X+  c2X2  +  ...  4-  cn_vXn-'  (4.36) 

be  the  transmitted  vector  and 

r(X)  =  r0  +  riX+r2X2  +  ...  +  r,,.^""1  (4.37) 

be  the  received  vector.     Then  the  channel  error,  e(X),  is  the  difference  between  the 
transmitted  and  received  vectors  and  is  a  symbol  from  GF(g), 

e  =  e0  +  e,  X  +  e2X2  +  ...  +  e^A7""1  (4.38) 

or  equivalently, 
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e{X)  =  r(X)  -  c(X)  (4.39) 

If  e(X)  represents  an  error  pattern  of  less  than  or  equal  to  /  errors,  at  positions 
A'i.X'2,  X'\  then 

e(X)  =  ejXil  +  ehXJ2  +  ...  +  ejXl.  (4.40) 

In  order  to  determine  the  error  vector,  the  error  locations,  j„  and  the  error  values,  eJ(f 
must  be  found.    Defining 

/^o7'    for  /=1,2,  ...,v  (4.41) 

as  the  error  locations,  the  value  of  the  error  at  the  location  corresponding  to  ft,  is  given 
by  the  following  equation  [Ref.  9]: 

ej=- — (4-42) 


[  ci+w1) 


where 

Z{X)  =  1  +  (S,  +  o})X+(S2  +  cr,S,  +  a2)X2  +  ... 

+  (Sv  +  ajS^j  +  o2Sv_2  +  ...  +  av)Xv  (4.43) 

where  Slf  S2. ....  S„  are  the  syndrome  components  S,  s. 
2.     Decoding  of  R-S  Codes 

In  order  to  decode  the  R-S  code,  the  procedure  is  the  same  as  that  for  any  q-ary 
BCH  code  with  the  addition  of  a  final  step.  Final  calculation  of  the  error  values  using 
Equation  (4.42)  is  necessary.  The  best  way  to  demonstrate  R-S  decoding  is  with  an  ex- 
ample [Ref.  9]. 

Consider  a  R-S  code  with  symbols  from  GF(24)  and  /  =  3.  The  generator 
polynomial  is: 

g(X)  =  (X  +  a)(X  +  a2)(X  +  a2)(X  +  a){X  +  *){X  +  a6)  (4.44) 

4    ,       10  v  i       3  v-2    ,       9  ,,3    .       9    4,       3V5    .     v*  <a  a  1    \ 

=  a   +  a    X  +  a  A    +  a  A    +  a  x  +  a  A    +  X  (4.44a) 
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Assume  that  the  all-zero  vector  was  transmitted  and  r,  the  received  vector  is  given  by  r 
=  (000of00a300000a400).  As  such,  r{X)  =  aW3  +  a3A'6  +  a4^12.  The  syndrome  compo- 
nents are  generated  using  Equation  (4.17): 

S]=r(a)  =  a10  +  a9  +  a  =  a12  (4.45a) 

S2  =  r(a2)  =  a13  +  1  (4.456) 

53  =  r(a3)  =  a  +  a6  4-  a10  =  a14  (4.45c) 

54  =  r(a4)  =  a4  4-  a12  4-  a7  =  a10  (A.ASd) 
S5  =  r(a5)  =  a7  +  a3  4-  a   =  0  (4.45e) 

S6  =  r(a6)  =  a10  +  a9  +  a  =  a12  (4.45/) 

Using  an  iterative  algorithm  developed  by  Berlekamp,  the  error  location  polynomial 
o{X)  must  be  found.  The  description  of  this  algorithm  is  a  lengthy  process  which  may 
be  found  in  References  9  and  13.  The  following  is  offered  without  proof.  The  error  lo- 
cation polynomial  o(X)  =  1  +  oCX+  a'X2  +  a6^  .  By  substituting  1,  a.  a2, ...,  a14  in  o{X), 
the  roots  of  o  (X)  are:  a3,  a9  and  a12.  These  are  the  error  location  numbers  of  the  error 
pattern  e(X)  and  the  errors  occur  at  positions  X*^'6  and  Xn. 

Now  the  error  values,  e  ,  must  be  computed  according  to  Equation  (4.42): 

i    <       2    -3    .       -6    .       6-9 

1  -f-  a.  a      4-  a      4-  a  a  ..  ... 

e3  = — p  _3  (4.46) 

(1  4-  a  a     )(1  +  a  'a     ) 

i    .       14    ,      9    ,       12  13 

I  +  a     +  a    +  a  a.  i 


14    7  6 

a    a  a 


=  a 


,    .       2    -6    ,      -12    ,      6    -18 

1  4-  a  a      -f  a       4-  a  a  IA  „_,. 

66  =       M   I     ^    -6VI   7      12    -6,  (44?) 

(1  4-  a  a     )(1  +  a    a     ) 


,    ,       11    .      3,      3  12 

1+a+a+a         a  3 

=  a 


9  9 

a  a 


,  2    -12    ,       -24    ,       6-36 

1  +  a  a       4-  a       4-  a  a 


en=     —  1  _12  ;         6-i2.  (4-48) 

(1  4-  a  a      )(1  4-  a  a      ) 
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1  +  a   +  a   +  1        a  4 

=  a 


5  5 

a  a 


Thus  the  final  error  pattern  is: 

e(X)  =  aX3  +  zX*  +  aXn  (4.49) 

This  corresponds  to  r(X)  —  c(X)  so  that  the  final  decoded  message  is  found  by  forming 
r(X)  —  e(X)  and  the  transmitted  all-zero  vector  is  therefore  recovered. 
3.     Performance  Evaluation  and  Application 

The  greatest  advantage  of  the  R-S  codes  is  that  they  achieve  the  largest  possible 
code  minimum  distance,  dmn.   This  distance  is  given  by: 

dmm  =  n-k+\  (4.50) 

Therefore,  R-S  coding  can  correct  up  to  /  errors  as  follows: 

"min  —  *  n  —  k  /  1  r  1  \ 

t— —  —7-  (4-51) 

and  therefore  only  requires  It  parity  bits. 

In  binary  (n,  k)  coding,  the  entire  n-tuple  space  is  comprised  of  2"  binary  words. 
Similarly,  the  A-tuple  space  is  made  up  of  2*  binary  words.  Since  R-S  codes  are  nonbi- 
nary,  the  «-tuple  space  is  expanded  to  wm-tuple  where  m  is  the  number  of  bits  used  to 
represent  each  symbol.  This  expands  the  codeword  space  to  2mn,  a  number  significantly 
larger  than  2".  This  also  makes  the  Am-tuple  space  larger  but  the  ratio  of/c/m  decreases. 
The  result  is  that  when  small  fractions  of  «-tuple  space  are  used  for  codewords,  a  code 
with  large  dmn  is  created. 

The  decoded  bit  error  probability  associated  with  a  R-S  code  follows  from  the 
results  shown  in  Equation  (3.8),  with  a  slight  modification.  The  upper  bound  to  PB  is 
given  by 

Wir?  Wi)0")',(,-'r'  (4'52) 


j=i+\ 


2-' 
2"'-l 
svmbol  error. 


where  the  scaling  factor  -r- — r  accounts  for  the  average  number  of  information  bits  per 
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F.     CONVOLUTIONAL  CODES 

Previous  sections  have  presented  various  block  codes  where  the  data  is  grouped  in 
A-bit  words  and  coded  into  n-bil  words  where  n/k  represents  the  redundancy  necessary 
for  error  detection  and  correction.  Contrasting  this  technique  are  convolutional  codes 
where  the  encoder  accepts  data  in  groups  of  A  symbols  and  provides  an  encoded  output 
in  groups  of  n  symbols,  where  n  >  k.  However  the  encoder  output  not  only  depends 
on  the  current  input  data  but  also  on  previous  data  blocks;  that  is,  the  encoder  has 
memory.  Convolutional  coding  is  affected  by  constraint  length  (number  of  stages  in  the 
shift  register)  and  code  rate,  R  =  k\n.  Significant  coding  gains  and  the  availibility  of 
decoding  algorithms  which  can  take  advantage  of  soft  receiver  decisions,  and  the  relative 
ease  with  which  both  the  encoder  and  decoder  can  be  implemented  have  lead  to  wide- 
spread use  of  convolutional  codes. 

The  most  commonly  used  convolutional  codes  utilize  k  =  1.  In  this  case,  infor- 
mation bits  are  shifted  into  the  encoder  one  bit  at  a  time.  As  the  i'h  bit  is  applied  to  the 
input  of  the  shift  register,  all  previous  bits  are  sequentially  shifted  one  stage  to  the  right 
and  modulo-2  summed  as  prescribed  by  the  generating  polynomial.  The  output  is  then 
transmitted  while  the  /'•'''  +  1  bit  is  applied  to  the  shift  register  input  and  the  procedure 
repeated. 

Examination  of  convolutional  coding  involves  characterization  of  the  encoder  and 
decoder.  The  encoder  can  be  described  by  one  of  three  approaches,  namely:  1)  the 
polynomial  matrix  approach,  2)  the  scalar  matrix  approach,  and  3)  the  shift  register  ap- 
proach. In  this  discussion,  the  later  will  be  used.  Likewise,  decoder  characterization  can 
also  be  described  through  one  of  three  approaches:  1)  state-diagram  approach,  2)  tree 
approach,  and  3)  trellis  approach. 

1.     Shift  Register  Approach 

A  (1/2,3)  convolutional  encoder  with  generator  polynominals  (X2  +  X+  1)  and 
(X2 +1)  shown  in  Figure  6,  will  be  used  as  an  example.  Selection  of  generator 
polynomials  is  purely  arbitrary  and  is  limited  only  by  the  number  of  stages  in  the  shift 
register.  Let  the  message  vector  m  =  (1  0  1),  the  shift  register  initially  loaded  with  all 
zeros  and  the  output  branch  word  formed  as  ul  u2  . 

The  initial  message  input  generates  an  output  of  1  1  from  the  modulo-2  adders. 
As  the  next  message  bit  is  applied,  the  initial  bit  is  shifted  one  stage  to  the  right  and  the 
output  is  now  1  0.  This  procedure  continues  until  the  message  vector  has  passed 
through  the  shift  register  and  (A"  -  1)  zeros  are  input  in  order  to  flush  the  register  to  its 
initial  all  zero  state.    In  this  example  the  ouput  sequence  is:    11  10  00  10  11. 
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Any  number  of  shift  registers  and  modulo-2  adders  may  be  used  depending  on 
the  complexity  desired.  Generating  polynomials  will  determine  the  number  and  location 
of  modulo-2  adders. 

2.     Trellis  Decoding  Approach 

The  trellis  diagram  for  the  (1/2,  3)  convolutional  encoder  is  shown  in  Figure  8. 


Figure  8.      Encoder  Trellis  Diagram:     (Rate  1/2,  K=  3) 

In  order  to  decode  using  a  trellis  diagram,  the  trellis  encoder  must  first  be  generated. 
It  is  formed  as  follows:  from  any  time  state,  /,  where  /'  =  1,2, ...,  2K,  there  are  one  of  two 
transitions  that  may  occur;  these  represent  either  a  1  or  0  being  applied  to  the  shift  reg- 
ister input.  By  mapping  the  result  of  each  time  period  to  the  next  time  period,  t,+l,  the 
trellis  can  be  completed.  The  symbols  on  each  of  the  branches  of  the  trellis  are  the 
modulo-2  added  output  as  a  result  of  transitions  from  one  time  period  to  the  next.  For 
instance,  referring  to  Figure  8,  at  /  =  3  in  the  1  0  state  an  input  of  0  will  result  in  a 
transition  to  the  0  1  state  at  u  along  the  branch  labeled  1  0.  The  output  as  a  result  of 
this  transition  would  be  the  same  as  the  branch  label,  1  0.  An  input  of  1  will  result  in 
transition  to  the  1  1  state  at  tA  along  the  branch  labeled  0  1.  A  completed  encode  trellis 
diagram  represents  all  possible  state-time  transitions  and  is  fundamental  to  trellis  de- 
coding. 
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The  decoding  algorithms  of  trellis  codes  can  be  lengthy  and  complicated  proc- 
esses. As  such,  these  will  not  be  explained  in  this  work.  References  13  and  14  are  re- 
commended for  detailed  discussions  of  trellis  decoding.  The  primary  objective  of  trellis 
decoding  is  to  find  the  singular  path  through  all  time  states  with  the  least  path  metric. 
Evaluating  the  necessary  steps  to  get  from  /,  to  tM  along  the  least  path  metric  will  result 
in  the  recovery  of  the  transmitted  message  with  the  fewest,  possibly  zero  errors. 

Viterbi's  convolutional  decoding  algorithm  [Ref.  15]  made  use  of  trellis  decoding 
combined  with  maximum  likelihood  decisions.    This  allows  the  option  of  soft-decision 
decoding,1*  resulting  in  recovered  message  with  a  lower  probability  of  error. 
3.     Performance  Evaluation 

Performance  evaluation  for  convolutionally  encoded  data  is  not  as  straightfor- 
ward a  procedure  as  with  both  BCH  and  R-S  coding.  As  stated  earlier,  there  are  three 
approaches  one  may  take  when  describing  convolutional  coding.  In  describing  per- 
formance evaluation,  most  approaches  use  a  combination  of  all  three  descriptive  meth- 
ods. In  this  work,  only  one  approach  was  used  in  detailing  convolutional  codes. 
Therefore,  some  terms,  associated  with  the  other  two  approaches,  must  be  defined  in 
order  to  continue  the  derivation  of  performance  equations.  Most  terms  will  be  intro- 
duced with  a  minimum  of  discussion.  Reference  15  provides  the  necessary  detailed  der- 
ivations. 

The  first  term  that  must  be  defined  is  the  minimum  free  distance,  dfr„  .  This  is 
the  weight  of  the  minimum- weight  path  which  begins  and  ends  in  the  zero  state  (weight 
corresponds  to  the  number  of  l's  in  a  sequence  of  binary  bits).  Its  usual  derivation 
comes  from  the  state-diagram  approach  but  an  analogy  to  the  trellis  approach  may  be 
made.  In  this  respect,  dfree  is  the  minimum  path  weight  a  code  may  have  when  diverging 
and  remerging  to  the  all-zero  path.  With  this  definition  in  hand,  the  first  event  error 
probability  may  be  expressed: 

Pf<  £  ndPd  (4.53) 

where  nd  is  the  number  of  codewords  with  weight  d  and  Pd  is  event  error  probability  of 
weight  d.   A  probability  of  bit  error  may  be  obtained  from  this  by  weighting  each  term 


4  Soft  decision  decoding  allows  for  confidence  levels  when  making  bit  decisions.  These  levels 
are  quantization  levels  in  the  demodulator  and  result  in  more  accurate  decisions  at  the  cost  of 
demodulator  and  decoding  complexity. 
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by  the  information  weight  for  each  path  (i.e.,  the  number  of  bit  errors).  However,  with 
a  code  rate  of  R  =  kjn,  there  are  k  symbols  decoded  on  each  branch.  So  now  PB  is 
bounded  bv: 


^4E  w<*p<*  (454) 

d=dfre, 

where  wd  is  the  total  number  of  non-zero  information  bits  on  all  d  weight  paths. 

Now,  using  the  matrix  approach,  it  can  be  shown  from  Reference  14  that: 


dT{D,K) 


dN 


N=\,D=7-Jp{\-p)  (4'55) 


where  p  =  Q(^EJX0  )  and 

D  =  redundancy  of  the  code 

N  =  unicity  distance  (branch  traversed  caused  by  an  input  of  1) 

T  =  generating  function  of  a  code. 

From 


oo        oo 


T(D,y}=  ]T  Yj"*0***  (456) 


it  follows: 


oo        oo 


dT\D,\)  V      V,  *rd 


ex 


y  Y,bndNd  (45?) 


oo 


=  Y  B*N*  (457a) 


d=dfree 


where 


Bd-Y,bn*  (458> 


b=\ 
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Now 


^<{Z   B^pd-p)]"  (4.59) 


for  a  convolutional  code  with  a  generating  function  T(D,  N). 

For  small  values  of  p,  Equation  (4.59)  is  dominated  by  the  first  term,  so  that: 
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Pb-  T  \.<  [^p{\-p)f"°  (4.60) 


1      n         ^df, 


dFree 


x-j-Bd    2"fr™  p   2  (4.60a) 

ft  "free  *  v  ' 

This  approximation  will  be  used  to  evaluate  the  performance  of  convolutionally  encoded 
data  for  various  codes,  and  contrasted  with  the  performance  of  block  encoded  data. 
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V.     CODING  FOR  THE  MFQPSK  SIGNAL 

When  measuring  the  benefits  of  one  particular  coding  scheme  versus  another,  a 
common  reference  must  be  established.  All  other  variables  being  equal,  the  coding  gain 
provided  by  each  coding  scheme  will  be  that  reference.  This  is  the  measure  of  the  de- 
crease in  the  SNR  allowed  through  coding  over  an  uncoded  signal  at  a  specific  bit  error 
probability.  In  this  evaluation,  a  bit  error  probability  of  10"$  will  be  the  fixed  evaluation 
level  and  the  performance  of  various  coding  schemes  measured  at  that  point.  The  cor- 
responding SNR  will  be  compared  to  the  required  SNR  of  the  uncoded  received  signal 
to  achieve  the  same  rate  and  the  corresponding  coding  gain  will  be  computed.  This 
coding  gain  will  be  the  final  performance  measurement  for  the  various  coding  schemes. 
This  evaluation  assumes  that  all  other  variables  are  equal,  even  though,  in  practice,  this 
may  not  be  valid  assumption.  Some  codes  yield  better  results  in  a  burst  error  environ- 
ment while  others  are  tailored  more  toward  correcting  random  errors.  The  complexity 
of  various  codes  and  their  ease  of  implementation  also  vary.  But  these  factors  cannot 
be  measured  quantitatively  and  be  objectively  weighted  in  an  overall  performance  eval- 
uation. However,  the  effects  of  each  of  these  factors  will  be  discussed  so  as  to  at  least 
provide  a  subjective  evaluation  of  each. 

A.     BLOCK  CODE  EVALUATION 

The  MFQPSK  signaling  system  can  be  implemented  using  various  packet  combina- 
tions of  M  tones  and  A'  bauds.  A  baseline  system  has  been  established  with  VI  =  64. 
Encoding  phase  information  at  each  frequency  bin  will  result  in  128  binary  bits  of  in- 
formation to  be  encoded  in  each  baud. 

1.     Hamming  Codes 

The  simplest  method  for  block  encoding  binary  data  uses  the  (7,  4)  Hamming 
code.  In  the  case  of  a  baud  length  of  128  bits,  it  is  obvious  that  the  bauds  must  be 
subdivided  into  what  will  be  refered  to  as  Hamming  blocks.  Each  Hamming  block  will 
contain  four  bits  of  information  and  the  requisite  three  parity  bits.  In  order  to  use  this 
scheme,  32  Hamming  blocks  are  necessary  to  encode  the  required  128  information  bits 
of  each  baud.  Since  each  frequency  bin  contains  a  di-bit  describing  a  phase,  coding  in- 
volves effectively  two  frequency  bins  per  Hamming  block. 
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The  Hamming  block  method  provides  a  very  good  code  rate  at  4/7  (.5714)  but 
is  limited  by  its  error  single  correcting  capability.  No  amount  of  increased  redundancy 
can  improve  this  constraint. 

Another  Hamming  code  that  would  be  useful  in  the  MFQPSK  signaling  system 
is  the  (15,  11)  Hamming  code.  This  has  a  code  rate  of  11/15  (.7333)  but  maintains  the 
single  error  correcting  capability.  The  (15,  11)  Hamming  code  would  be  effective  for 
block  lengths  of  16  where  the  additional  bit  can  be  used  as  a  parity  check  thus  enabling 
the  (15,  11)  code  to  detect  the  existence  of  a  double  error  or  it  can  be  used  as  a  timing 
or  synchronization  bit.  As  shown  in  Figure  9,  the  (15,  11)  Hamming  code  provides  a 
coding  gain  of  1.3  dB  at  a  bit  error  probability  of  10-5. 

The  use  of  Hamming  codes  suggest  short  block  lengths.  This  is  because  of  the 
Hamming  codes'  limit  of  t  =  1  error  correcting  capability.  If  this  limit  were  applied  to 
the  entire  baud,  then  the  baud  would  have  an  error  correcting  capability  equal  to  ex- 
actly the  number  of  blocks  of  16  coded  bits.  But  the  errors  would  have  to  occur  at  a  rate 
of  no  more  than  one  error  per  block  coded  bits  for  the  Hamming  code  to  be  successful. 
For  this  reason,  Hamming  codes  are  not  useful  in  environments  where  burst  errors  are 
dominant. 
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Figure  9.       Bit  Error  Probability  for  Several  Block  Codes 

2.     BCH  Codes 

Lin  and  Costello  [Ref.  13,  Appendix  C]  have  documented  BCH  codes  up  to 
length  210  -  I,  showing  various  combinations  of  block  lengths  and  information  bits  along 
with  their  respective  generating  polynomials.  While  creating  an  inordinately  large  block 
length,  like  (1023,  11)/=  255,  in  order  to  take  advantage  of  the  large  error  correcting 
capability,  the  added  block  length  increases  the  transmission  bandwidth  and  the  de- 
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creases  code  rate  (.011  in  this  example).   This  is  unacceptable  for  the  application  of  in- 
terest here.  To  combat  this,  it  is  desired  to  have  the  block  length  long  enough  to  encode 
the  data  with  a  code  that  has  an  acceptable  error  correcting  capability.    In  the  example 
of  transmitting  64  frequencies  (128  information  bits)  two  approaches  may  be  taken. 
a.    A  (127,  64)  BCH  Code 

To  maintain  a  baud-to-block  length  continuity,  a  (127,  64)  with  t  =  10 
BCH  code  can  be  used.  In  this  case,  each  baud  that  is  transmitted  contains  64  infor- 
mation bits  as  well  as  the  63  parity  bits  in  order  to  generate  a  block  of  127  coded  bits. 
A  block  parity  bit  may  be  added  to  increase  block  length  to  128  elements.  Computer 
programs  used  to  evaluate  the  performance  of  various  schemes  utilizing  BCH  codes  (see 
Appendix  A)  have  shown  that  the  effect  of  the  added  parity  bit  is  negligible.  That  is,  the 
SNR  at  any  bit  error  probability  is  decreased  by  less  than  .1  dB.  At  a  bit  error  proba- 
bility of  10-5,  the  coding  gain  achieved  for  the  (127,  64)  BCH  code  is  2.8  dB.  This  result 
is  shown  in  Figure  10. 
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Figure  10.      Bit  Error  Probabilities  for  BCH  Codes 

b.     A  (255,  139)  BCH  Code 

In  order  to  include  all  128  information  bits  of  one  baud  in  a  single  block, 
a  (255,  139)  with  /  =  15  BCH  may  be  used.  This  will  maintain  baud  continuity  in  that 
all  the  128  information  bits  are  encoded  in  the  same  block.  The  (255,  139)  code  allows 
for  139  information  bits,  11  more  than  that  contained  in  the  individual  baud.  What  to 
do  with  the  extra  information  positions  can  be  the  subject  of  further  research.   Possibil- 
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ities  include  using  the  1 1  extra  information  positions  as  synchronization  data  bits.  In 
this  manner,  the  signal  will  be  synchronized  every  baud  and  eliminates  the  necessity  of 
a  synchronization  tone  or  preamble.  Perhaps  cryptographic  keying  information  may  be 
contained  in  the  11  extra  positions.  Again  the  addition  of  an  overall  parity  bit,  like  the 
previous  (127,  64)  BCH  code  is  necessary.  Figure  11  shows  the  information/parity  bit 
relationship  of  the  modified  (255,  139)  BCH  code. 
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Figure  11.      Bit  Stream  for  a  Modified  (255,139)  BCH  Code 

Figure  10  shows  that  at  a  bit  error  probability  of  10-5,  the  coding  gain  of  the 
(255,  139)  BCH  code  is  3.8  dB.  This  is  a  substantial  decrease  in  SNR  at  a  given  bit  error 
probability  and  clearly  illustrates  the  advantages  of  error  correcting  codes.  It  should 
also  be  added  that  increased  redundancy  does  not  always  mean  improvements  in  error 
performance  and,  hence,  coding  gain.  Performance  degrades  substantially  at  very  high 
and  very  low  data  rates.  For  medium  code  rate  block  codes  (1/3  to  1/4),  a  broad  range 
of  coding  gains  occur  and  are  subject  to  increased  redundancy.  Outside  this  region,  re- 
dundancy does  little  to  increase  coding  gains. 

BCH  codes,  because  they  are  a  generalized  version  of  Hamming  codes,  are 
more  effective  as  random  error  correcting  codes  and  have  limited  use  in  a  burst  error 
environment.  However,  BCH  codes  do  offer  the  advantage  of  variable  block  lengths  and 
improved  performance  with  low  implementational  complexity. 


38 


3.     Reed-Solomon  Codes 

Reed-Solomon  codes  offer  significant  error  correcting  capabilities.  This  is  be- 
cause they  have  the  largest  possible  code  minimum  distance  of  any  block  code  of  the 
same  length.  Minimum  distance  equals  n  —  k  +  1  and  the  /-error  correcting  capability 
is: 

_   "mm  ~  *    _    tl  —  k 


Because  of  their  large  error  correcting  capability  and  corresponding  moderate  code  rates, 
these  codes  tend  to  offer  great  coding  gains.  Continuing  example  in  which  processing 
128  binary  information  bits  is  required,  two  particular  R-S  are  considered. 

a.  A  (127,  65)  R-S  Code 

Using  arguments  similar  to  those  used  previously  in  the  discussion  of  the 
(127,  64)  BCH  code,  the  (127,  65)  with  /  =  31  R-S  code  can  maintain  the  baud-to-block 
length  continuity.  However,  an  information  sequence  parity  check  bit  is  needed  for  the 
code's  completion.  An  additional  overall  parity  check  bit  will  result  in  a  block  length 
of  2'  where  /  is  an  integer.  The  error  performance  associated  with  this  code  is  illustrated 
in  Figure  12.  At  a  bit  error  probability  of  10~5,  the  (127,  65)  R-S  code  has  a  coding  gain 
of7.5dB. 

b.  A  (255,  133)  R-S  Code 

The  (255.  133)  with  /  =  61  R-S  code  offers  large  error  correcting  capability 
and  coding  gains.  In  the  application  of  processing  128  information  bits,  information  bit 
continuity  is  maintained  per  block.  That  is,  all  128  information  bits  are  contained  in  one 
encoded  block.  But  again,  like  its  BCH  counterpart,  signal  bandwidth  is  doubled  be- 
cause the  encoded  block  is  approximately  twice  as  long  as  the  information  bits  contained 
in  the  baud.  The  extra  information  bits  available  in  the  block  code  (five  in  this  case)  and 
the  addition  of  an  overall  parity  check  bit  occur  here  in  a  manner  similar  to  that  en- 
countered for  BCH  codes. 

The  greatest  advantage  of  Reed-Solomon  coding  is  the  ability  to  correct 
errors  that  occur  in  short  bursts  where  the  bursts  approximately  match  the  symbol  size, 
m,  in  a  2m  length  code.  Conversely,  R-S  codes  do  not  perform  as  well  as  BCH  codes  in 
a  random  error  environment. 
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Figure  12.      Bit  Error  Probabilities  for  Reed-Solomon  Codes 

B.     CONVOLUTIONAL  CODE  EVALUATION 

From  Equation  (4.60a)  the  variables  involved  in  specifying  the  performance  of  a 
convolutional  code  are  primarily  influenced  by  the  values  of  dfitt.  This  factor,  in  turn,  is 
a  parameter  of  the  constraint  length  of  a  code,  K.  It  is  desirable,  in  terms  of  perform- 
ance levels,  to  use  the  largest  value  of  K  without  unnecessarily  complicating  the 
encoder/decoder  structure.    Odenwalder  investigated  a  code's  constraint  length  versus 
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coding  complexity  and  documented  the  results  in  Ref.  16.  A  convolutional  code  of 
constraint  length,  K  =  7,  using  a  Viterbi  decoding  algorithm  was  found  to  yield  the  best 
overall  performance  characteristics.  Therfore  only  convolutional  codes  with  K  =  1  and 
Viterbi  decoding  will  be  considered  here.  An  additional  condition  that  must  be  estab- 
lished prior  to  the  code's  evaluation  is  the  code  rate.  While  evaluating  possible  block 
codes  in  the  previous  section,  code  rates  very  near  1/2  were  considered.  In  order  to 
preserve  a  consistent  evaluation,  convolutional  codes  with  R  =  1/2  will  be  evaluated. 
Code  rates  of  less  than  1/2  will  provide  better  decoded  bit  error  rate  performance  but  this 
improved  performance  will  come  at  the  cost  of  bandwidth  and  receiver  complexity. 

With  the  above  conditions  (K  =  7,  R  =  1/2),  convolutional  codes  can  be  considered 
for  which  the  free  distance,  d/m  is  a  fixed  value  of  10.  At  dfi„  =  10,  Bd  =  36.  (These 
values  are  tabulated  for  various  values  of  dfree  on  page  625  of  Reference  15.)  A  computer 
program  (see  Appendix  B)  was  used  to  evaluate  various  convolutional  codes  based  on 
combinations  of  df,ee  and  Bdt  .  The  results  are  illustrated  in  Figure  13.  The  coding  gain 
achieved  can  be  measured  from  Figure  13  as  3.2  dB  for  d/ree  =  10.  Increasing  d/r„  to  12 
generates  a  Bd  of  211  and  a  coding  gain  of  3.9  dB.  The  free  distance  can  be  increased 
as  the  Hamming  distance  between  two  codewords  is  increased.  However,  this  will  result 
in  a  different  value  for  B,     as  tabulated  in  Reference  15. 

l'/ree 

To  complete  the  examples  presented  Figure  13,  a  K  =  5,  R  =  1/2  convolutional 
code  is  included.  In  this  case,  dftt,  =  7  and  Bd  —  4.  This  example  is  included  because 
a  K=  5.  R  =  1/2  code  is  available  in  a  single  integrated  circuit  and  would  be  simple  to 
implement.  Using  the  convolutional  code  incorporated  in  this  integrated  circuit,  a  cod- 
ing gain  of  2.5  dB  will  be  achieved. 

Convolutional  codes  in  general  respond  very  well  in  a  burst  error  environment. 
Specific  classes  of  convolutional  codes  have  been  developed  to  further  improve  the  burst 
errors  correcting  capabilities.  The  Berlekamp-Preparata  code  and  the  Iwadare-Massey 
code  are  two  of  these  codes  and  are  discussed  on  pages  430  -  440  of  Reference  14. 
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Figure  13.      Bit  Error  Probabilities  for  Various  Convolutional  Codes 
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VI.     CONCLUSIONS 

A.     THE  MFQPSK  SIGNALING  SYSTEM 

This  study  has  presented  the  fundamental  principles  of  a  multi-frequency  modu- 
lation (MFM)  scheme.  The  major  factor  for  considering  this  scheme  is  the  potential  use 
of  this  modulation  technique  in  a  variety  of  media.  More  specifically,  the  MFM  scheme 
was  directed  towards  a  Multiple  Frequency  Quaternary  Phase  Shift  Keyed  (MFQPSK) 
signaling  system  in  an  underwater  acoustic  signaling  application.  The  MFQPSK  sig- 
naling system  was  first  presented,  and  then  followed  by  the  establishment  that  error 
detection  correction  (EDC)  is  a  desireable  feature  for  insuring  fidelity  of  the  received 
signal.  However  with  the  many  EDC  coding  schemes  available,  a  determination  of  those 
best  suited  for  the  signaling  system  under  consideration  had  to  be  made.  Decoded  bit 
error  rate  performance  using  various  block  and  convolutional  codes  were  evaluated  and 
a  computer  program  generated  to  calculate  and  plot  these  bit  error  probabilities  as  a 
function  of  SNR.  After  considering  specific  coding  schemes  (such  as  Hamming,  Golay, 
BCH.  R-S.  and  convolutional  codes),  a  determination  was  made  as  to  how  each  of  the 
selected  coding  schemes  could  be  used  in  conjunction  with  the  MFQPSK  signaling  sys- 
tem. 

The  performance  of  each  of  the  many  block  codes  and  convolutional  codes  vary 
when  subjected  to  different  channel  environments.  In  an  environment  in  which  random 
errors  most  often  occur,  Hamming.  Golay,  and  BCH  codes  outperform  R-S  and 
convolutional  codes  as  a  whole.  This  is  a  broad  generalization,  but  one  which  can  be 
substantiated  by  evaluating  error  performance  associated  with  each  of  the  codes.  It  is 
evident  that  if  the  channel  environment  can  be  successfully  predicted  (determination  of 
burst  versus  random  error  conditions),  then  the  EDC  coding  selection  would  be  simpli- 
fied. However,  the  channel  environment  cannot  be  accurately  predicted.  Furthermore, 
the  channel  medium  must  be  characterized  and  modeled  accurately.  However  the  degree 
of  complexity  of  this  effort  is  such  that  a  separate  project  is  being  carried  out,  concur- 
rently with  this  study,  that  involves  modeling  an  underwater  acoustic  channel  as  the 
medium  for  propogation  of  the  MFQPSK  signal.  Until  such  time  as  experimental  results 
can  verify  the  channel  model  being  developed,  all  results  are  subject  to  the  validity  of  the 
assumptions  in  the  model. 
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When  using  block  codes  for  EDC  in  the  iMFQPSK  system,  selection  of  baud  length 
to  be  transmitted  will  affect  the  selection  of  a  block  code  to  be  used.  Hamming  codes 
provide  adequate  coding  gains  when  used  as  a  short  block  code  in  a  random  error  envi- 
ronment, but  are  limited  by  their  error  correcting  capability.  BCH  codes  yield  good 
coding  gains  at  the  specified  value  of  bit  error  probability  used  in  this  project.  BCH 
codes  offer  a  wide  selection  of  block  lengths  and  error  correcting  capabilities,  with  good 
responcs  when  used  in  environments  where  random  errors  dominate.  R-S  codes  provide 
substantial  coding  gains,  however  at  a  price  that  R-S  codes  being  <?-ary  codes,  block 
lengths  are  large  (a  R-S  code  where  q  =  2  is  the  same  as  a  binary  BCH  code).  These 
large  block  lengths  add  complexity  to  the  encoder  and  decoder  structures. 

A  class  of  codes  that  perform  well  in  environments  where  either  type  of  error,  ran- 
dom or  burst,  occur  are  the  group  of  convolutional  codes.  Since  convolutional  code's 
performance  is  dependent  on  the  number  of  stages  in  the  shift  register  used  to  generate 
the  code,  their  implementation  tends  to  be  less  complex  than  that  of  block  codes.  The 
number  of  stages  in  the  shift  register,  called  the  constraint  length,  affects  two  parame- 
ters, namely  (dfree  and  Bd  J  which  are  used  in  the  evaluation  of  bit  error  rate  performance 
of  convolutionally  encoded  data.  Once  a  constraint  length  is  established,  these  two  pa- 
rameters can  be  determined  and  performance  evaluated.  An  advantage  of  applying 
convolutional  codes  to  the  MFQPSK  signal  system  is  the  inherent  ability  to  process  the 
bit  stream  continuously.  As  bauds  become  filled  with  information  (binary  data),  they 
can  be  processed  through  the  convolutional  encoder  while  other  bauds  are  filled  with 
more  information. 

In  conclusion,  convolutional  codes  were  found  to  provide  adequate  values  of  bit 
error  probabilities  over  a  wide  range  of  SNR's  and  significant  coding  gains.  Addi- 
tionally, they  are  relatively  easy  to  implement  and  are  well  suited  to  the  MFQPSK  sig- 
naling system  and  its  signal  structure. 

B.     AREAS  OF  CONTINUED  RESEARCH 

The  EDC  codes  studied  in  this  project  were  developed  singularly.  Coding  schemes 
used  in  existing  communication  systems  use  a  combination  of  these  individual  codes. 
Such  codes  are  referred  to  as  concatenated  or  interleaved  codes.  Concatenation  is  a 
method  of  constructing  long  codes  from  shorter  codes.  Concatenated  coding  can  be 
explained  by  the  following:  encode  an  information  bit  stream  initially  using  a  R-S  code 
and  then  process  the  resulting  encoded  bit  stream  through  a  convolutional  encoder.  This 
double  coding  results  in  concatenation.    Coding  gains  provided  by  concatenated  codes 
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and  their  application  to  the  MFQPSK  signaling  system  present  research  areas  which 
have  as  yet  not  been  addressed.  Additionally,  as  channel  models  are  further  refined, 
various  EDC  coding  schemes  that  incorporate  these  channel  models  can  be  further  re- 
fined, analyzed,  and  verified  by  experimental  results. 


45 


APPENDIX  A.     BCH  AND  R-S  CODING  PERFORMANCE  EVALUATION 

The  purpose  of  this  computer  program  is  to  evaluate  and  plot  BCH  and  R-S  coding 
performance  curves  on  the  IBM  mainframe  computer  at  the  Naval  Postgraduate  School 
with  calls  to  the  IMSL10  library.  The  output  graph  will  be  a  semi-logarithmic  scale  of 
Bit  Error  Probability  vs.  SNR.  The  input  data  will  consist  of  the  code's  description. 
For  example,  if  a  (127,  64)  t  =  10  BCH  code  were  to  be  evaluated,  the  inputs  would  be 
K=  64.0,  n  —  127,  and  t  =  10.  It  is  imperative  that  the  values  are  used  as  described  in  the 
initial  declarations.  Specifically,  n  and  t  must  be  integers.  This  permits  successful  calls 
to  subroutines  and  functions  external  to  this  program.  The  equations  this  program  is 
designed  to  calculate  are  given  by  Equations  (4.30)  and  (4.31)  for  BCH  codes,  and  by 
Equation  (4.52)  for  R-S  codes. 

Flexibility  is  built  into  this  program  so  that  R-S  codes  may  also  be  computed  using 

this  program.   Program  lines  which  need  modification  depending  on  which  code  is  being 

computed  are  noted  with  an  asterisk  (*). 

C 

C 

C 

C     VARIABLE  DECLARATIONS 

C 

REAL  BC,  JJ,  TT,  NN,  Z,  SF 

REAL  R,  SNR,  XPLT(2000),  YPLT(2000),  S,  TWO,  K 

DOUBLE  PRECISION  X,  Q,  PI,  P2 

DOUBLE  PRECISION  PROB ,  TEMPI,  TEMP2 

INTEGER  II,  J,  T,  N,  TP1 
C 
C 

C     VARIABLE  INPUTS 
C 

K  =  64.  0 

N  =  127 

T  =  10 
C  *  M  =  7 

C     This  is  needed  to  generate  the  scaling  factor  for  R-S  codes  and 
C     is  different  for  each  code.   M=7  is  an  example  only. 
C 

C      INITIALIZATION 
C 

II  =  0 

R  =  K/N 

J  =  T  +  1 

TP1  =  J 

TWO  =  2 

S  =  SQRT(TWO) 
C   *   SF  =  (2  **  (M  -  l))/((2  **  M)  -1) 
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C     This  is  the  scaling  factor  for  R-S  codes. 
C 

PROGRAM  COMPUTATION.   This  starts  the  loop.   For  each  value 
of  Z,  a  Q( . )  is  calculated  and  later  used  in  computing 
probability.   The  DERFC  is  a  double  precision  intrinsic 
function  describing  the  co-error  function  as  defined  in 
C     Equation  (3.2).   The  BINOM  is  another  intrinsic  function 

which  computes  the  binomial  coefficient  of  N  and  J  for 
C  each  iteration  of  J.  R  represents  the  code  rate,  K/N. 
C 

DO  100,  Z  =  1,  40,  1 
X  =  SQRT(2  *  R  *  Z) 
Q  =  .5  *  DERFC(X/S) 
SNR  =  10  *  AL0G10(Z) 
PROB  =  0.  0 
DO  80,  J  =  TP1,  N 
BC  =  BIN0M(N,J) 
NN  =  N 
JJ  =  J 
XT  =  T 

PI  =  ((JJ  +  TT)/NN) 
P2  =  ((1  -  Q)  **  NN) 
TEMPI  =  PI  *  BC  *  P2 
TEMP2  =  (Q/Cl-Q))  **  (JJ/100.0) 
DO  20,  K  =  1,  100 

IF  (TEMPI  .  GE.  1E-75)  THEN 
C 

C  This  IF  statement  was  necessary  to  prevent 

C  underflow  problems  on  the  IBM  mainframe. 

C  Any  value  less  than  1E-75  was  considered 

C  equal  to  zero.   While  this  is  recognized  as 

C  undesirable,  it  was  necessary  to  continue  with 

C  the  program. 

C 

TEMPI  =  TEMPI  *  TEMP2 
ELSE 

TEMPI  =  0.0 
END  IF 
20  CONTINUE 

C  *        IF  BCH  THEN 

PROB  =  PROB  +  TEMPI 
C  *        ELSE,  R-S 
C  *        RS  =  SF  *  PROB 
C 

WRITE  (81,200)  SNR,  PROB 
80     CONTINUE 

II  =  II  +  1 
XPLT(II)  =  SNR 
YPLT(II)  =  PROB 


100  CONTINUE 
C 
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200  FORMAT(2X,  F7.4,  2X,  D12.7,/) 
C 
C 

C     PLOTTING.  This  plotting  routine  is  unique  to  the  DISSPLA  graphics 
C     program,  version  9. 0.   Explanations  and  applications  are  best 
C     addressed  by  the  reference  manual  and  will  not  be  individually 
C     considered. 
C 

CALL  COMPRS 

CALL  PAGE(11,8.5) 

CALL  NOBRDR 

CALL  AREA2D(6,8) 

CALL  XNAMEC  SNR  $' ,100) 

CALL  YNAMEC  BIT  ERROR  PROBABILITY  $',100) 

CALL  HEADINC  BCH  CODED  PROBABILITY  $f, 100, 4,1) 

CALL  GRACE(O.O) 

CALL  YL0G(4.  0,1.  5,0.  0000000001,1.  0) 

CALL  SETCLR( ' MAGENTA' ) 

CALL  CURVE (XPLT,YPLT, 10,0) 

CALL  ENDGR(l) 

CALL  ENDPL(l) 

CALL  D0NEPL 
C 

STOP 

END 
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APPENDIX  B.     CONVOLUTIONAL  CODING  PERFORMANCE 

EVALUATION 

The  purpose  of  this  algorithm  is  to  compute  and  plot  convolutional  coding  per- 
formance curves.  Equation  (4.60a)  defines  the  equation  used  in  this  program.  As  in 
Appendix  A,  the  semi-logarithmic  axes  will  be  Bit  Error  Probability  and  SNR. 

Variables  are  defined  as  follows: 

BDF^Bd 

"free 

and 

DF=>dfree 

and  K=>  constraint  length  of  the  code. 

C 

C 

C     VARIABLE  DECLARATIONS 

C 

REAL  DF,  BDF,  K,  S,  SNR,  XPLT(500),  YPLT(500),  T,  Z 

DOUBLE  PRECISION  X,  Q,  PROB 

INTEGER  II 
C 
C 

C     VARIABLE  INPUTS 
C 

DF  =  7.0 

BDF  =  4. 0 

K  =  7.0 
C 
C 

C     INITIALIZATION 
C 

D2  =  DF/2 

T  =  2.  0 

S  =  SQRT(T) 

II  =  0 
C 
C 

C     PROGRAM  COMPUTATION.   For  each  value  of  Z,  a  Q( . )  is  determined. 
C     DERFC  is  a  double  precision  intrinsic  function  describing  the 
C     co-error  function  as  defined  in  Equation  (3. 2). 
C 


DO  100,  Z  =  1,  20,  1 
X  =  SQRT(Z) 
Q  =  .5  *  DERFC(X/S) 
SNR  =  10  *  ALOG10(Z) 
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P  =  (1/K)  *  BDF  *  (2  **  DF)  *  (Q  **  D2) 
C 

WRITE  (9,  200)  SNR,  PROB 
II  =  II  +  1 
XPLT(II)  =  SNR 
YPLT(II)  =  PROB 
100  CONTINUE 
C 

200  FORMAT  (2X,  F7.4,  2X,  D12. 7,/) 
C 

C     PLOTTING.   This  plotting  routine  is  unique  to  the  DISSPLA  graphics 
C     program,  version  9. 0.   Explanations  and  applications  are  best 
C     addressed  by  the  reference  manual  and  will  not  be  individually 
C     considered. 
C 

CALL  COMPRS 

CALL  PAGE(11,8.5) 

CALL  NOBRDR 

CALL  AREA2D(6,8) 

CALL  XNAME(  ' SNR  $' ,100) 

CALL  YNAME(  'PROBABILITY  $',100) 

CALL  HEADIN(  ' CONVOLUTIONAL  CODE  PERFORMANCE  $',100,4,1) 

CALL  GRACE  (0.0) 

CALL  YL0G(3.  0,1.  5,0.  000000001,1.  0) 

CALL  SETCLR( 'MAGENTA') 

CALL  CURVE (XPLT,YPLT, 20,0) 

CALL  ENDGR(l) 

CALL  ENDPL(l) 

CALL  DONEPL 
C 

STOP 

END 
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